Concentration inequalities for random fields via coupling
نویسنده
چکیده
We present a new and simple approach to concentration inequalities for functions around their expectation with respect to non-product measures, i.e., for dependent random variables. Our method is based on coupling ideas and does not use information inequalities. When one has a uniform control on the coupling, this leads to exponential concentration inequalities. When such a uniform control is no more possible, this leads to polynomial or stretched-exponential concentration inequalities. Our abstract results apply to Gibbs random fields, in particular to the low-temperature Ising model which is a concrete example of non-uniformity of the coupling.
منابع مشابه
Deviation inequalities via coupling for stochastic processes and random fields
We present a new and simple approach to deviation inequalities for non-product measures, i.e., for dependent random variables. Our method is based on coupling. We illustrate our abstract results with chains with complete connections and Gibbsian random fields, both at high and low temperature.
متن کاملConcentration of measures via size biased couplings
Let Y be a nonnegative random variable with mean μ and finite positive variance σ, and let Y , defined on the same space as Y , have the Y size biased distribution, that is, the distribution characterized by E[Y f(Y )] = μEf(Y s) for all functions f for which these expectations exist. Under a variety of conditions on the coupling of Y and Y , including combinations of boundedness and monotonici...
متن کاملConcentration inequalities for Markov processes via coupling
We obtain moment and Gaussian bounds for general Lipschitz functions evaluated along the sample path of a Markov chain. We treat Markov chains on general (possibly unbounded) state spaces via a coupling method. If the first moment of the coupling time exists, then we obtain a variance inequality. If a moment of order 1+ ǫ of the coupling time exists, then depending on the behavior of the statio...
متن کاملConcentration Inequalities for Dependent Random Variables via the Martingale Method
Abstract: We use the martingale method to establish concentration inequalities for a class of dependent random sequences on a countable state space, with the constants in the inequalities expressed in terms of certain mixing coefficients. Along the way, we obtain bounds on certain martingale differences associated with the random sequences, which may be of independent interest. As an applicatio...
متن کاملMatrix Concentration Inequalities via the Method of Exchangeable Pairs1 by Lester Mackey2,
This paper derives exponential concentration inequalities and polynomial moment inequalities for the spectral norm of a random matrix. The analysis requires a matrix extension of the scalar concentration theory developed by Sourav Chatterjee using Stein’s method of exchangeable pairs. When applied to a sum of independent random matrices, this approach yields matrix generalizations of the classi...
متن کامل